Mapping Sound to Image in Interactive Multimedia Art
نویسندگان
چکیده
We describe an approach and framework for integrating synthesis and processing of digital image and sound. The approach is based on creating an analogy between sound and image by introducing the notion of the soxel, a representation analogous to the pixel. We describe some simple mappings between two domains that map pitch, time, spatial coordinates and timbre to bitmap mode, gray-scale mode, RGB color mode, and layer mode for images. The framework described, sonART, is a powerful multimedia application for integration of image and sound processing with flexible network communication.
منابع مشابه
SonART: A framework for data sonification, visualization and networked multimedia applications
SonART is a flexible, multi-purpose multimedia environment that allows for networked collaborative interaction with applications for art, science and industry. In this paper we describe the integration of image and audio that SonART enables. An arbitrary number of layered canvases, each with independent control of opacity, RGB values, etc., can transmit or receive data using Open Sound Control....
متن کاملIntroduction of DIPS Programming Technique
DIPS, (Digital Image Processing with Sound), is a set of Max objects that handle real-time visual image processing events and OpenGL functions in the jMax GUI programming environment. In this paper we introduce DIPS programming techniques and programming strategies for interactive multimedia art. DIPS for Linux and Mac OS X has been released under GPL and can be downloaded from http://dacreatio...
متن کاملIntroduction of Dips3 (Version 2) for Max/MSP
DIPS (Digital Image Processing with Sound), was released publicly in 2000 in order to support the creation of interactive multimedia art. However, while it realizes sophisticated real-time image processing in the Max/ MSP environment and quite effective interaction between sound and visual events the number of DIPS users have been limited because DIPS is based on OpenGL technology and users are...
متن کاملA standard Interactive Multimedia eBook Generator Engine for e-Learning Process
Introduction: Using standard authoring tools is essential to promote E-Learning in teaching-learning process. Learning content in medical sciences often consists of multimedia elements. On the other hand, it is frequently required to revise and update the medical content. Hence, access to the authoring tools that can encompass multimedia elements and allow easy content revision is helpful in e-...
متن کاملGenerative Audio - Visual Interactive Artworks
The paper discusses developments in linear generative audio-visual art and shows how these have been extended into interactive art systems. The idea of integrating sound and vision in art goes back at least to the early 1700s with Louis-Bertrand Caste’s ‘Colour Organ’ In the work described here, the idea is to operate with structures that can mediate between sound and vision, so that a unified ...
متن کامل